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ABSTRACT . 

This analysis of Kow the federal government might 
best promote excellence in education via instructional technology 
identifies strengths and weaknesses of instructional technology 
during the 1980 's, indicates^how technology might aid "the teaching 
and learning process, and suggests, how the federal goverment might 
best assist states and localities in utilizing technology to improve 
educational achievement.* Definitions of terms are followed by a brief 
review of the role of the federal government In education from the 
1960's to the recent return of educational responsibilities from the 
federal level to the state and local governments. Giving special 
attention to the role the federal government should jilay in promoting 
instructional technology, the remainder of the analysis builds on 
these' definitions and preliminary- observations. Specific sections 
address early development in instructional design, a brief history of 
federal support for educational research £rid its consequences , 
current* strengths and weaknesses of instructional technology , using 
instructional systems design in computer based^ instruction 
development, .arid the use of, technology in instruction Conclusions , 
recommendations, and a 42-item reference list are included. (LMM) 
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An Analysis of the Federal Role in 
InstructTitiial Technology in the Era 

of the New Federalism * . ^ 

Joseph M. Scandur^- Ph.D. 4 
The' primary aim 6f this analysis is to determine how the federal 
government might best pxjpote excellence in education via instructional 
technology. More specifically, the purposes of this inquirv are 
threefold: 1) to identify strengths and weaknesses of instructional 
technology duriftg the 1*980' s* 2) to indicate how technology might aid the 
teaching and learning process and 3) to determine how the federal 
government might best assist states and localities in utilizing technology 
to improve -educational achievement. .In the latter regard, a reassessment 
of 'the roles and responsibilities of federal, state^ and w local governments, 
of business and of parents seems ijiiperative. 

Any such analysis will necessarily depend heavily on the ways in 

which "educational technology"^ and "the new federalism" are defined.' We 

■» • • * 

begin, therefore, by defining these terms. " \y, 

Educational technology connotes different things to different people. 

* This analysis was conmissioned and supported in part by the 
National Institute of Education, Office of the Assistant Secretary. 
This support, however, does not imply N.I.E. or U.S.O.E. endorsenienj:. 
While accepting full responsibility for the views expressed, the i 
author is deeply indebted to John Durqin, Frank *F r . Farley, " . 
M. David Merrill, Raul Merrill. Joseph D. Novak. Harry O'Neil, Ellis 
P. Page, Charles Reigeluth and Robert Tennyson for nany* helpful 
suggestions concerning both a draft of this manuqjfript and an invited 
' synposium presentation on the substance o^fhe paper at -the American * 
Educational Research Association meeting in Montreal on April 14 , 
1983. ^ 



*To some it refers to the use of technology in the educational process . 
This interpretation, not surprisingly is favored by tho6e charged most 
directly with the delivery Sf instruction: administrators . teachers. 
audi^/V^deo specialists, computer specialists, etc. To others, the term 

"educational technology" refers primarily to the principles and techniques 

•» « 

used. in designing instructional systems. The resulting systems frequently 

bpt not necessarily are intended for delivery via. technology. Not 

* • 
surprisingly, the latter interpretation tends to be preferred by those 

associated wi£h academic and research environments: universities. 

research laboratories and center 4, and even centralized instructional 

development centers associated y with large schoo\ districts cUjd states. 

Those R&D specialists who are most directly involved in instructional 

systems development tend to enphasize relatively familiar educational 

design procedures such as behavioral objectives, criterion referenced 

testing, and task analysis. Correspondingly , academic leaders in the 

field teni to place more enphasis on basic instructional theory and design 

techniques derived therefrom (e.g., Gagne & Briggs, 1974; Scandura, 1977)* 

* • 

In this analysis, "educational technology" refers to both 
instructional theory and design and the use of technology 4 in the delivery 
^of instruction. V " 

. For several decades, beginning with the 1960's, the federal 
government has come to play an increasing role, in education. Initially, x 
funds provided for research at universities and later for innovation' in 
schools came relatively free of explicit federal controls. Gradually, 

regulation and direction came to be increasingly centralized so that by 

i . ■ 

• r i 
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pel proportion of funds were being used explicitly to 
means of education. By 1980. the federal role in 



education was sufficiently pervasive as to greatly testrict and often 
control the acti^ties of states and local governments. This progressive 
loss of self-de€^^pati9n frequently made it difficult to achieve local 
ends and, in many cases- angered parditsr who felt that their role was 
being usurped by a large bureaucracy oyec which they have no effective 
control. 

In the present context, the "new federalism" refers to the return of 
educational responsibilities from the fedeVal level to the state and, local 



) 



governments. Indirectly, it also refers toythe reassignment , of 
educational roles among government, private enterprise ar^d independent 
agencies, and students 1 parents so as to more efficiently, effectively and 
responsibly promote excellence- in education. Special attention is givten 
to the role the federal government should play in promoting instructional 
9 technology. , . ' ' 

x 

Hie, remainder of the analysis builds on these definitions and 
preliminary observations: 



I. Early Developments in Instructional D^ign 




II. A Brief History of federal Support *'f or Educational 
Research and its Consequences - 
. Instructional Technology: Current Strengths and Weaknesses 
IV. Using^frnstructional Systems Design in CBI Development ^ 
V«l The Use of Technology in Instruction ~~ 



1 



VI. Conclusions and Reconmendations 



- ' ; I. EARLY QEVELOEMEMTS IN IlB^BttJCTIONAL DESIGN AND CBI 

- Much was heard during the late 1950' s and early 1960's aix>ut the 

fc science- of learning and the technology of teaching (C.F.., Melton et. , al., 
1959). Early realizations*" of t educational technology (e.g., involving 
progranined learning and teaching machines) were frequently based directly 



on existent learning theories of the day % V | 

* Skinnerians, for example, sought to Convince us that schedules of ♦ 
reinforcenent, shown' to work so successfully with pigeons-aReM^ower ^ 
mammals, would almost certainly save Jthe day f or human education as welj..' 
Many educators rightly "saw the folly of this approach hit had very little 1 
substantive scientific information cn which to base their objections. The 
alternative idea of instructional "branching" was advanced ^by individuals ' 
like Robert Crowder (e.g. , -1959) , for , example, but little other than 
intuition was advanced as a^asis for such branching. 

c Early Developments iii * Computer ^Based Instruction.— Shis was the 
milieu into which coqputer-based instruction (CBI) was introduced in the - 
1960's (e.g., by Suppes and his colleagues at Stanford and Stolurow at; 
Illinois). At that time many were predicting that CBI wcJuld revolutionize 
e<tication, changing radically and permanent ly the means by which education 
would be delivered to the mass of our youth. . Alas, the predicted . 
t revolution did not take place at that time for three najor reasons. 

1) Hie costs for hardware and for software development during this 
early period were prohibitive. Still many demonstrations and some 
impiimentat ions of CBI systems were developed at several major - 



•' ' . AS : \ ' : 

.imiyersities, in the military and in a few large corporations. All of 
these er forts, however, were heavily dependent, an federal funds. The 
Plato system at the University o£ Illinois, 'for exampl^ utilized n&ny 
millions of federal dollar fe.^ Plato has had limited ccmnercial .success, 
despite these federal subsidies and, subsequently, a £ecade long arid ttf 
date unprofitable H^estirieht by. the Control Data Corporation reportedly of 
about 900 milUon do^ars.. Plato 1 s development h&s been air unlikeiy 
^sc^r^io'ine^. possible largely by r the strong continued support of the 
chiet operating officer- of that, corporation. . - , i 

i 2) Hie second major problem during this early period was reliability. 

•Hie delivery of>£Bl was totally and capriciously dependent on the 

* v V " . , '•».'»! 

effective functioning of lcfcge cejvtralized ccnputerfe. All* too frequently 9 
these ccnpiters were down for maintainahce or repairs, making it difficult 
and sometimes impossible to maintain a smoothly functioning instructional 

. V 

program. 

§ „ • 3) Perhaps roost important, too little was known about how to design . 
effective instruction, ^especially instruction which by its nature is 
highly dynamic and interactive. At that time, interactive instruction was 
considered primarily an arjb f om to be 'mastertefl only in varying degrees by 
human practitioners. . ^ ' . 

Gradually, things be^an to change. Ohe I960 1 s* and ~1970'fiL saw 
considerable ^rowth^in instructional systems design. Increasingly,, it 
became possible to design instructional systems by systematic means an a 
m^nnej: not unlike the way an engineer might plan a bridge f for* example. 
Widespread ufie of the term "^cationa* .engineering" in this context is no 



accident r Then , beginning in the mid 1970 ■ p snail?; low cost , and * 
reliable jnicroocnputefs wete intrdduced.' T^y r ]kkrfely seven years later 
microconpiters constitute* a multibillion dollar industry. Although 
educational uses have lagged behind those r in recreation and business, 
widespread intact of jMnypute^^ education seems assured. . /. , 



II. A BRIEF HISTORY OP FEDERAL SUPPORT FOR EDUCATIONAL 
r RESEARCH AND ITS CONSEQUENCES * .j 

Sputnik brought about a vastly increased concern for iirpro\rihg 
scientific^eSGcation ih the late I960 1 a. initially these concerns were* 
centered on matheitatics an& the physical sciences, in a few years this 
concern spread to all sciences and later to* education generally. 
Moreover, by the early mid 1960's it became increasingly recognized that 
little was known about the educational process. It was 'at that time, for 
exanple, that the theories of Piaget and their potential applicability to 
education were fifst "rediscovered" — as it turns out 40 years aftet those 
theories were first annunciated. tonsequdntly, federal support for 
scientific investigation in education increased at a phenomenal rate. 
Although there were notable exceptions, most research supported under the 
old Cooperative Education Research Act was concerned with such easily* 1 
measured variables such as class size, method of instruction (e.g. r 
discovery versus expository) and ustf of computer' assisted instruction 
versus non-use, "TV, etc. % 

From this early research and ^t the risk of slight 
over salification/ only two major and reliable results ererged (both with 
precursors in the past) : 1) students learn what they spend time doing 
(i.e., what they are taught) and 2) the methods and media used to teach 
content does not matter much as long as it is t^udit well.- CBI r for 
example, is neither good nor bad in and of itself^ The results of sbch 
instruction depend on what is being ccwnunicated and £he csrk with which 
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_ it is done . 
*'. ~ i \ Flush wl 



rflth funds, a number .of initiatives can be traced from this 

period: 1) a carpet itively awarded research •contracts program, 2) 

• r - - : \ 

educational research centers and, later f laboratories and 3) Title- I and 

» • 

Title III programs aimed 'more directly at the practice* of education . J A 
substantial portion of these funds was used to support educational 
technology. However, most of the money later was increasingly 
concentrated at a few centers and'in some cases was used to subsidize 
coroner cially infeasible efforts in computer-based instruction. 

In many % ways the most productive programs during this period were the 
snail contracts and basic research programs, at the Department of 
Education., including those administered with' collaboration of the^tional 
Academy of Sciences, ^t this time during the 1960's a considerable amount 
of innovative research was begun, much of it freaking necessary ground for 
the contenporary developments of today. 

• Although nctt so intended, establishment of the National Institute of 
Education (NIE) during the early 1970' s, led to the near demise of federal 
support 1 for serious educational research, by independent investigators. By 

the late 1970' evenly about 4% of NIE^s funds were being awarded on a 

• * 

ccnpetitive basis (e.g., Eferley, 1980; tffege, 1980). .-A disproportionate 

y 

percentage of available support was (and is) being awarded by 
congressional mandate on a preferential basis to the various labs and 
centers, irrespective of the quality of contribution. 

In this -austere environment,, the limited grant competitions that were 
held during this period were largely counterproductive.* As few as one or 
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. _ ■ two of literally hundreds of unsolicited proposals wire funded annually 
_ with ; the costs of proposal writing aifarte far exceeding the support 
It" provided for actual research. Under / these circumstances, it would have 

been far better not to hold the carpet it ion at all. 
\ ' Consequences of this Federal Inter vent ion. — TVo developments which 
redilted from Office of Education ajiid NIE sponsored research and 
^development during the 1970's are particularly relevant to this analysis. 

j ' & . 

-First, most support for educational research during this period. was v ' 

i ■ * 

concent rated at a small number of preferentially funded research centers 
and laboratories. Indeed, the presence of center and laboratory* 
associated ped^pnnel on many research review panels during this period not 
only allowed the centers to obtain funds on a noncompetitive basis but in, 

• v« " ... 

1 large measure to determine their own carpet it ion. As one .colleague has 

put it, (federal) government funding patterns beginning in* the early i ■ 

iSTCC^s have often had the efffe^t of "watering the weeds." 

Even more ominous has been the amipresent political influence bf the 

• labs* and centers. According to a recent past president of the influential 

American Educational Research Association (AERA) (Proffessor Ellis B. Page, 

personal ccranunicaticn) , the Idb/center consortium "packed the Executive 

Council of the AERA and then acted as a bloc to . , re<XOTnerid , ... N 

(continued caimitment) to the existing labs and centers-" Failing this <f 

t 

attenpt, these groups , in concert with political allies, have apparently 
succeeded in ousting NIE leaders- and council" meniDers ^i^ lave attenpted to 
introduce open competition in research funding. . These groups currently 
are maintaining intense pressure to ensure continued lab and center 
dominance. ; 



A' fiepond major development pf concern involved the efficacy- of large 

f " , ■ . , 

scale curriculum development efforts supported by thp Office of Education 

■ ■ • - * 

during ithe l960 f s and 1970 f s. Much of this research-had tapered off by 

the mid-late 1970 f s f so it is instructive to consider the extent to which ° 

% « 

th06e development* efforts actually impacted on the educational system. 
Perhaps the best publicized early, effort in this regard was the 
individually prescribed instruction (IPI) project conducted, by the 
JLearning Research and Development Center at the University of Pittsburg. 
This effort was a hastily contrived attenpt to impose an 'incomplete 
behavioral philosophy on the actual operation of a school. Early on. the 
IPI curriculum consisted of cutting and pasting curriculum naterials from 
a variety of conmercial sources. Later, with considerable federal - 
support, these materials w6re refined and tested at several levels both byr 
the Center in Pittsburg and by the Research for Better Schools Laboratory 
in Philadelphia. ■ ■ ' 

One might expect' that the results of such an effort would have been 
quickly adopted by schools and/br conmercial publishers. As it turned , 
out, with a few inconse?juent ia 1 exceptions, very little of this curriculum 
material was thought to have ^conmercial value and sijnply never na'de it to 
either the market place or to schools. " • ' 

In retrospect, it would have been far ' better to have used support 
allocated for GBI and curriculum development for the development and ^ 
„ testing of a broader range of prototypes. Such an approach would have 
yielded far more useful information at proportionately less post. Ihe IPI 
illustration is rejfniniscent of governmental support o£ Iangely to the 
exclusion of the Wright brothers and illustrates the folly of 



.werenftasizing one or another approach at the j expensfe of carpeting ideas, 
The .same money yould have been £ar ^^t^ta spent supporting development of 
a- variety of compgtipg optians,£rom which cSUiercial developers an3 ; the , 
n^ket^laa& rotold^ve fp^ly seleptedV 

4 '-.. > / Similar conments can be made regarding the quality *of the* research 
^epanating from many of the labs and centers.; Generally, the quality of 
that research has been spotty w^th an oftep embarrassingly low p^pporti^a 
6f repdttfi being published in reputable and referreed scientific journals 

* (e.g, . 1 atemtyson,,pers^^ Indeed*- it'is hard to pinpoint, 

one ^ new ideal? that was initiated~^ by/lab^f and center personnel — ' 

as was put by k;ofessor Novafc of Cornell University* (personal 4 \. 
ccmnun^catioq), "I cannot think of a singl^ significant contribution that 
has cone out pf all of the support for NIE Centers and Laboratories (nany 
Qf -whom are still itfired in S-R behaviorism}." 

The "better" labs and centers, however, have Sometimes been quick to 

capitalize cn research and" ideas developed by others. Among these ideas? 

-» ■ 

are task analysis (e.g.. Gagne, 1962). the development of items forms in 
criterion referenced testing (initially developed by Hively et'al, 1968) r 
and cognitive learning and performance (e.g.. Scandura. 1971|^NeWell and 
Simon, 1972) . 

Increasingly during the 1970's and 1980's.'a& justification for 
... _ ■* ■ a . * w ■ 

, • • , ' 

ftfture fec^ral support , some purportedly innovative problems have been 

proposed for study., In reteent -years, the study of cognitive learning, as 

opposed to perfonrance, and the application of cognitive theocy to 

/ /- — - ' . * 

instructioh fall in this category (e.g. ,.Resnick, :L981) . The implication 



of such proposals has been that they are new, challenging, unsolved 



• X 12 • 

f - \ 

1 - • 

problems for the-future. In fact; there' is a large body; of research in 

both areas. conducted by independent researchers both in this country and 

abroad (e.g., landa, 1974; Novak. 1966? Pask. 1975; Scandura^ 1971. 1973. 

1976 r 1977) which has been largely unreferenced although apparently used 

as a. source of^ideas in lab and center reports (e.g. - see>Scandura 1977a; 

1977b. Chapter 15; 1980). 

An even more recent example of this sort appeared in the APA Monitor 
to the effect that "the most significant (recent) advance in (cognitive • 
science) is the capability to analyze the cognitive requirements needed t 
ccnplete ccnplex tasks" (April/ 1983 , p. 8). This analyst , having been 
actively involved in such work* while the individual quoted was still 
studying S-R paired-nassociate learning, cannot heifc but find such 
statements both amusing and inconprehensible. 

Needless to say, federal support for secondary efforts of this sort 
is indefensible in these days of highly restricted budgets , especially 

under the preferentially biased subsidies provided for lab and center 

; . . . \ 

activities. . ' 

The problem has been put succintly by Robert Tennyson of the 
University of Minnesota (personal^conmunication) . "Without a pipeline to 
Washington (e.g.. in terms of former students or colleagues in the 
bureaucracy) there is little chance of funding." He further postulates "a 
direct correlation between the number of former students in an agency anc 
the amount of funding received." One might add that it is doubtful that 
the preferentially funded labs and centers could have maintained 
themselves on merit were it not for stronq political support. 

: ' 13 . ' 
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III. DBTOUCTIONAL TECHNOLOGY: CURRENT STRENGTHS AM) WEAKNESSES 
Any consideration of current strengths and weaknesses in 
instructional technology must distinguish between what is currently known 
about instructional technology as a methodology (i.e. , the strengths and 
weaknesses of current design and development methodologies) and the / 

current state of educational technology in the sense of the use of ^ >. 

• >n 

technology for- learning and instructional purposes. ; 

v Theory and Technique. — Among those who believe that instruction may 
be viewed at least partly as a science or technology, rither ithan ^just an 
art (e.g., Bork, Mager, Popham, Gage, Gagne, Glaser, Landa, Merrill,, Pask, 
Reigeluth, Scandura and Tennyson) , it is generally believed'that 
instructional design involves specifying: (1) the goals or objectives of 
instruction in behavioral terms (i.e., in terms of what the learner is to 
be able to do after learning) , (2) which of the specified objectives the 
learner has arid has not /met prior to instruction and (3) techniques for 
agisting the learner to move from where he or she is toward the specified 
goals. L 

Unquestionably, the most widely used technique for specif yihg 

v 

i ■ i ■ 

instructional goals involves behavioral objectives (e.g., Mager, 1968). 

s 

Although variations exist, behavioral objectives essentially involve 
specifying educational goals in terms of observables. 

It also is widely recognized that criterion referenced testing 
provides a sounder basis for planning instruction than does norma£iye - : 
testing. In the latter, students are tested on broad samplings of tasks 



from <at "best vaguely define^ donains (of tasks). This approach to testings 
is usefrul for comparing the generalized achievement levels 06 students 
(hence its widespread use in standardized testing). In general, however, 
normative testing does not pinpoint what individual students do and, do not 
know in a way that lends itself to instructional decision making , 
Instructional purposes are better served via criterion referenced testing 
because student capabilities are judged relative to' predetermined 
sjtandards (i.e., the goals of instruction). 

Although most instructional designers believe that the above . If 

techniques can play an important role in developing instructional systems,^ 

( p 
there tends to be less agreement as to the sufficiency of these techniques 

or v as to instructional methods. In" general, the 'designer 1 s perspective 

depends neavily on the role which cognitive processes, rather than just 

observable behavior, are assumed to play* At one extreme, are those 

caimitted* to purely peripheral explanation, prediction, and behavioral 

control. In this camp, for example, are those who espouse such well known 

Skinner ian techniques as shaping (i.e., reinforcing student responses 

which tend toward desired goals) , fading (providing progressively fewer* , 

clues 96 to what the learner is to do as learning progresses), and 

schedules 6f reinf brcenieht While the validity of theTO tedihi^ 

been demunstrated repeatedly in animal experimentation, nost contenix>rary 

instructional designers recognize that much more is required for effective 

j 

instruction. Schedules of reinforcement, for example, have more to do 
with motivation than learning per se (e.g., Scan&ira, 1973) 7~~ 

Recognition of the importance of task structure in designing human 



instructicn led to the development of task -analysis in . postwar ^ears 

Me.g., Gagne, 1962), In task analysis, the criterion tasks^ (specified 
t ' ' * .... 

^operationally in observable terms) constitute only a, beginning. By 

repeatedly asking the question of what the learner must be able to do in 

order to do what is desired, the analyst constructs a hierarchy of tasKs 

to be mastered with the criterion task at the apex. Those tasks 

•^jnnediately below are assumed to be necessary prerequisites for the former 

in the sense that they must be mastered before the Criterion can be 

(mastered) . Similarly/ tasks below the prerequisites must be mastere^ 

betore the prerequisites can — and so on. At the bottom of the hierarchy 

are tasics tnat are so simple that they can be assumed available to 

everyone (in the targeted student population) ■ * 

With the emergence of cognitive thinking during the late 1960's and 

early 1970 f s, two major limitations of behavioral objectives became 

apparent (e.g., Scandura, 1971). First, specifying behavioral objectives 

leaves unanswered the question of what (e.g. , cognitive processes) must be 

learned in order to perform as desired. Knowing how an objective is to be 

achieve^ is not just v an idle concern because any educational objective can 

be achieved in any number of ways. Thus, one can solve verbal problems in 

arithmetic, prove mathenatical theorems of construct a paragraph by any 

....... , ^ . .. , ^ , 

number of methods. Moreover, even where each method achieves the same 
educational objective, the long term value of particular methods (e.g., 
for subsequent learning) may differ dramatically. As a simple example, 
consider two students, one of whom has learned to pronounce words, by "look 
and say" methods and one who has mastered phonetic analysis The latter 

.'- j 

16 



_ student would be feu: more likely to figure out for him or herself how to 
_ pronounce a new word than would the former. ■ 

fe The second major limitation is that behavioral objectives would not 

be^suf f icient — even if one were to specify the corresponding cognitive 

process. As stated by Scandura (1971) 

-"Because the characterizing (processes) are 
discrete, they can not account for behavior which goes* ^ 
beyond the^given corpus, except in the most trivial 
sense. Por t ^ample f suppose the characterization only 
included (processes) for adding, subtracting, 
multiplying and dividing. In this case, the student 
would be unable to even generate the addition fact 
(e.g., 5 + 4 = 9) corresponding to a given subtraction 
fact (e.g., 9-4 = 5), although one might reasonably 
expect this type of behavior from a person who was 
well versed in arithmetic. One might counter, of 
course, that ±t would be a snail thing to siriply add a ^ 
new objectiv^for process to the original list (which 
relates the. original ones)... Indeed, this is \ 
precisely the sort of teply one might expect from a 
person of the operational objectives persuasion. When. 
, confronted with the criticism that their objectives do 
not constitute a ...viable curriculum, they would 
sinply say we can add more objectives. 

"Hie trouble with this sort of argument is that ' 
it misses the point entirely. Not only would such an % 
• f approach' be ad hoc . . . but it would be completely 
' 'infeasible where one is striving for completeness. 

..It is sufficient to note that a new (process) would 
have to be introduced for every conceivable 
' interrelationship and that the number \>f such 

interrelationships is indefinitely large..;" 

To allow for the unexpected (i.e., to provide for the possiblity of 

building creativity into instruction), Scandura (e.g., 1971) introduced 

the idea of higher-order rules. Higher-order rules may be thought of as 

generalized strategies, together with networks of interrelated knowledge 

structures, by which new knowledge (i.e., new rules) may be -derived as 



needed, Hius, for example, even if the creative student hab hot been 

9 taught explicitly hgw to solve a given class of problems, the possibility 

*v • 

< •'■>."■■ * „ . , . , , 

exists that he or she nay have learned general strategies (ir.e;V 

higher-order rules) which allow one to derive solution methods Where 

needed. Various kinds of higher-order rules have been demonstrated to be 

valid for this purpose r ' ranging from creation by analogy, to combining 

known information r to automating existing knowledge (as . is necessary in 

achieving highly skilled performance) • For'' present purposes, it is 

sufficient to, simply ncite that many such higher-border capabilities exist 

ana may be learned to good effect. 

B^se ana other advances in xxjg^irtiye representation have led to 
increasing recognition that traditional task analysis pe* se is not in 
itself sufficient for purposes qf instructional design. It is not 
sufficient to §inply identify prerequisite tasks. For one thing, methods 
are needed to identify the 'Cogaitive processes U.e'. , knowledge structures 
and processes) underlying such tasks, for tift^ purpose, various methods 
of cognitive task analysis have been irittodiced independently by a number 
o^ investigators (e.g., P. F. Merriil; 1982; Eask, 1975;- and > -\ 

Scandura,1971)« The methods introduced by Pask and Scandura explicitly 
provifle for the^ idi^.ti£ication ( 6f Higher-order prooessesr^; 

ifcrk on these problems has cai^jiued throughout the 1970' s and is 
still underway. No tone has yet developed a method of cognitive tatek* 
analysis which both leads to behaviorally precise cdgnitive 
representations and is completely general, systematic and objective; ^ 



r_ /however , the method/of structual analysis (e.g., Scandura, 1982 k , 1983) 
• • • 

appears to go furthet, in this direction ^than others. 

t - Although cognitive learning is highly relevant to instucticnal 

design, discussion of this topic herd would take us too far field. It is 

sufficient for present purposes to simply point out' that introducing 

higher-order rules into cognitive representations (including structures on 

which they operate}., together with a general purposk control mechanism 

\ > 
which has been sham to be universally available to school age children, 

provides a highly efficient 2&d generalized means for explaining, 

predicting and, within the limits of behavioral science, enhancing 

cognitive learning (e.g., see Scandura, 1971, 1973, 1974, 1977). Eask 

( (1975) also has developed an approach to explaining cognitive learning, 

albeit one based on different although potentially compatible principles. 

V These advances in cognition have provided more exacting (i.e., • 

v precise and reli&bl6) bases fbr criterion referenced testing. Except J when 

testing with respect to the simplest behavioral objectives (e.g. , being 

able to state the capital of Virginia), the test items 5 associated with any 

. * . « ■ ^ ■ ■ . ' . : \ 

given criterion (e.g., the ability to add jiumbers) are not necessarily 
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ivailent. In general, students will pe^orm* successfully on some of the 
items but not others. The question arises-, therefore, as to what kinds of 
test items and how many are needed for any given criterion. 

Two basic approaches to this problem arose independently and more or 
less simultaneously in the late 1960's and early 1970 , s (e.g., Hively, 

Pater son & Page, 1968; Landa, 1974; Scandura, 1971; tXirnin & Scandura, 

j > 
1973). Hively et al (1968) , for example, introduced the notion of item 



is 



i forms. The item forms associated! with any given criterion (in criterion 
_ referenced testing) are essentially categories based on the visibles forms 
ft of associated test items (e.g^, as to whether^ubtrartion problems involve 
- one, two or three digit numbers). This method prpved useful in sonie cases 
in partitioning items into categories which were relatively homogehious, 
in the sense that students tended to be either uniformally successful or 
uhitormaily unsuccessful on items in any given category. Where such 
homogeneity was achieved, criterion referenced tests could be constructed 
by sixnply sampling one or more items from each category (associated with 
the corresponding criterion referenced objective). 

Despite theic potential utility, the basis for such categorization 
(via item forms) remained obscure and the method itself seemed to work 
better with some kinds of content (criteria)/ than others. In contrast, 
the methods proposed by Landa (1974) and Scandura (1971, 1973) are based 
more directly on cognitive processes.* Items associated with a .given 
criterion are partitioned into equivalent categories based on the actual 
processes required for solving them, ttiis approach to categorization 
yielded a method which was at once both more precise ancftmore- generally 
applicable (than in the case of item forms) . 1 



' x m 

♦Whereas the methods proposed by Landa and Scandura can be 
shown to b6 "taathematicaliy* equivalent (e.g., Chang & Lee, 
1977) , "Landa was mm^ iiiinediatiely concerned with applications 
while Scandurafwcis primarily concerned wSJ&h broadefr . 
theoretical implications. ( : 



<.JfcandUra and his associates (e.g., Efurnin & Scamdura, 1973; Scanduta, 
_ 1973, 1977; Scandura, Dumin, Ehrenprise & Wulfeck, 1977) furt^^ ^ 
t demonstrated, that the pategories of items associated with a .wide variet^ 
of , criterion referenced taskd were jjotonly highly hanogenious but that 
they were hierarchically related, Ohis latter result provided a basis for 
highly efficient sequential testing. Not only' could one restrict testing 
to as few as one item per category but one could infer success or failure 
on mtested categories on the basis of the prescribed hierarchical 
relationships among categories. Uhus, as with traditional task analysis, 
success on one category (task) would duply success on all prerequisite 

categories (tasks), while failure would imply failure for all 

♦ ■ * z 
supfer ordinate categories (tasks). * 

through the use of such inferencing it often is possible to assess 

relatively carplex capabilities with as few as two or three carefully 

* choosen test items, {indeed, there is reason to believe that the 
infere&ing^potential inherent in such a scheme effectively systematizes 
ana is on a-paf witfh what skillful "diagnosticians (i.e., teachers) 
frequently do informally in the classroom. 

^Tes^pg wi£h respect to^underiying processes has, been shown to have 
^tl^^dditiflnal advantage of providing an explicit basis for instruction 
f(e.g. , IXirnin £ Scandura, 1973). Byause particular categories of . items 
are associated with particular cognitive processes, it is possible to 
inter with considerable precision which cognitive processes are known and 
which are not. This information, together with prespecifiedj^elatipnships 
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_- among the various processes, provides a precise basis'both for determining 
_ what any given student needs to learn and the order in which it might, best 
fc be taught." • 4 " 

Many of the ideas inherent, in the above were,' adopted either formally 

\ * ■* 

or otherwise in other areas of behavioral science, areas ^angikg from • 
assessing stages of child development (e.g., Seigler, 1979;.WUlfeck 1979) 
to the systematic detection of inadequacies in cognitive processes (called 
-bugs") by means of computer (e.g-., Browr(& Burton, 1978). ""Recently, 
Scandura (ly81) has describe^ how the more basic of these ideas might be s 
iinplemented in a contemporary microcomputer environment. Js\ the process,,- 

"he described a general purpose development system of this sort for 
creating* commercially viable software (e.g., Scandura, 1981.) . " 

In earlier more basic research, Scandura (1977) had shown how similar 
ideas could be extended to arbitrarily* complex domains of tasks, involving 
indeterminately -large numbers of different educational objectives: >!n ' 
briet, this was accomplished by introducing and'testing with respect to 

" sets . of underlying rules, including higher-order rules. With the 

exception or a few advanced. prototype developments\(e.g>; Wulfeck & 

Scandura, 1977), however, very little has yet been done to capitalize, on 

these ideas in more applied aspects of educational- technology. 

• % . • ^ - ■ 

To summarize, analysis of the available literature,- and of major 

presentations at* national and international symposiuTtis>leads this analvfet 

to the conclusion that a considerable amount, of information has been - 

accumulated which would be especially usef^in the design of^istruction 

for delivery, by computer." ' .' ' 
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One should not infer, however, ttet everyone agrees we know as much 
as suggested about how to* design instruction. .As recently as 1983 r for 
gxanple, researchers at some of the more influential N.I.E. supported^ & 

D centers have proposed that one of the najor challenges of the. 80' s will v 

~ > v 
be to determine hew we can make* use in designing instruction of wtat has 

been learnt in cognitive psychology (e.g.- see Resnick. 1981; Cordis, 

1983). Similar proposals have been made* with regard to the need to study 

cognitive learning *ck*ring the lgSO's. These calls for. "new" research 

. ** 
apparently stem from the facts that computer -simulation studies in 

*» . 

cognitive science during the lgtiO's and 1970's were almost exclusively 
concerned with cognitive "performance" and not "learning" (e.g.. Newell & 
Simon, 1972) and that the individuals responsible either were not awfire of 

earlier research on cognitive learning (e.g. , Ausubel, 1968; Bask, 1975; 

* ' ■ . • l- 

Scanadra, 1971 , 1974) or, for whatever reasoh. did not recognize its 

I 

relevance. Given this limited perspective, it is easy to see why they 
might think of cognitive learning as a new problem. * t 

If nothing else, these illustrations show clearly how governmental 
>rt of only one line of- basic research in an area over a period of 
time\(in this case for over a decade) <sn lead to a "watering of the^ 
weeds" so to speak. Without serious competition in research, as in other 
walks. of life, the country's knowledge lifeline^ suffers problems not 
unlike those attributable to other monopolies. [ 
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. ' IV. USING ifeTRDCTIONAL .SYSTEMS 
-~ ■ DESIGN IN CBI DEVELOPMENT , , ' • 

^ £ Developing effective and efficient aa^ter J^ased ih^tuctiw is dot ■ 
an easy or inexpensive task. At a minimum, it requires:-* considerable - 
knowledge of computers,, or at least knoyledg^of how to program; intimate ^ 
familiarity with the subject natter involved; and methods for presenting 
the subject natter in ways that promote learning. 1 

To aid the process, considerable attention during: the I960 1 s' was ^ 
given to the development of CBI-type programing languages such a s ~> 
OOUR&EWRIIER, HJFDR, PILOT, etc. These languages are relatively easy to 
learn and have been designed to facilitate the selection Vid presentation •■ 
of course and test materials. While designed to be general purpose and . 
- easy to learn, the available languages are nonetheless better suited to 
CBI development in some areas than in others.- Moreover, the author is not 
only free but obliged to specif test and instructional sequences; most 
CBI programming languages proyide little guidance in this respect. 'In 
Effect, 'although high level CBI progranmingJ.an^ facilitate CBI 
authoring, the process still requires considerable familiarity with 
computer progra^nrning, with subject natter and -with instructional design — a 
coritoinaticn of knowledge and skills not easy to 7 find in. any one 
individual. This f^ct almost certainiy has led as much as an^hing to the 
(meven quality of current GBI systems. . * ^ 

' To help aJtielioratie the problem, a growing number of CBI specialists 
have argued in favor of. developing authoring systems in combination with 
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general purpose "drivers" (e.g.,. Scandura. 19&tl; Tennyson, *1981) . 
Authoring systems allow authors to create course material using the 
English language and easily. learned codes. Th^s naterial is usually 
entered into authoring systems in response to specific prorrp6 and is 
automatically coded. The driver program, in turn, operates on the coded 
material (as data) * presenting it in a predetermined, but potentially, 
conditional, sequence determined by the driver and the student inputs 
(e.g. ■ student responses to questions) . , K 

m A ' 

■ ■ • ■ *5 . 

In order for author /driver systems to function properly, various 
restriction^ must be placed on the form -of the course material. This is 
necessary, for example, to insure that the driver is able to locate the 
right information at the right time. These restrictions typically limit 
either the variety of subject natter that can be ijnpiem£nted successfully 
' and/or the instucticnal effectiveness of the implementation. Thus, for 
example, while mo6t subject natter can be "forced" into a given format the 
resulting instruction may be less than optimal. 

In spite of the previously cited advances,; few cccnriercially* available 
authoring systems make serious use of current knowledge concerning 
cognitive processes andi/or instructional, theory^-knowledge that is 
increasingly available to the instructional design conmunity but which has 
not yet beccm^ widely use<3 in CBI development. % (Ihe Rule-Example, oriented* 
authoring system used in the TIOCIT CBI'effort was ah early attempt to 
move in this direction.) 

Indeed, it. is well beyond the^ Conner ically viable' "state of the art" 
■to' contemplate at this time the development of cognitivelyHoased 



- -generative authoring systems thaj;, might be' used with arbitrarily conplex v 
^and interrelate^ content, lhere are^ however, some kinds 7 of content- which 
fc^rB sufficiently well understood to provide considerable hope in this 

• regard. As described previously, research over the previous two decades 

. v ■ ■■ . % « ■ ;* : " . . - 

provides,, considerable insight* not only into what has sometimes* beei^ called 

rule-bas^d (or "algorithmic") knowledge ; but also into effective and * 

/'< > l . - : - ... - - ■ '■ ,v- ' V': "'' 

-efficient techniques for^assessing the knowledge of students 'andT for 

providing remedial instruction. In £his regard it shdul<j be enphasized 

that many topics traditionally taught in schools can be reduced' to rtile, ^ 

' or algorithmic, terms. .Hie familiar arithmetic algdrithms provide a ^ 

jstandard butWrdly exhaustive illustration. Most manipulations of 

concrete objects, as well a£ granmar (adding "ing" to words) , for example, 

- lend themselves readily to this type of analysis. * 

k In spite of the relative complexity of cognitive-based development * 

systems, the advantages of such methods would have a number of important 
.* * » . - . - ■ » .* 

consequences.'- In contrast with fixed-content authoring systems, sUch as 

■ * '** ^ V' f 

have been described above, content would be ihtimately 't%e6 to the 

. V * ' ' ■ ' , ■ 

underlying cognitive processes needed for nastery. In this case; rather 

11 * . ■ i ■ . ■ ' ... .-I'-" 

than having t© prepare all instructions, questior^, answers and ; ^feedback 

i i . >t * ■ \ . . ■ ': - * , 

in. advance, it is possible %p envisage CBI systems in whic^ directions, 
■ - ■• * \ ■ > . -~ 

questions and other instructional content are generated by the computer on 

' • ^ -■ '." . , ■ ■ ' : > 

the "fly" so to spe^k, as it is needed by the student. In the same way;. 

diagnostic testing and instructional remediation would follow natural!^ : 

from analysis of the underlying cognitive requirements of theJContent • in 

the meaner outlined aboye. ^' 



The sim^est examples Tof "this type of CBI System, undoubtedly involve 
^ simple drill and'^pwi'ctice. Such systems currently are available from a 
fc ntimber of comer cial publishers. 

A mord general and ambitious CBI system of this sort is the general - 

purpose RuleTutor (e.g. , Scandura, 1982) . This system takes as input a 

»» 

corputer coded version of the rule or rules (i.e., cognitive processes) 
needed to solve th€> class of tasks at hand. When this code is combined^ 

witn trie general purpose RuleTutor code f the result is a rather 

« 

sophisticated diagnostic and tutorial instructional system for teaching 
and testing the associated content. Given the rule code, the RuleTutor 
- generates problems as needed, presents th^jjji to the student, grades them 
and automatically presentsPthe needed information. 

As it stands, the RuleTutor lacks one major t&juirement for a full o 
fledged computerized authoring system. While the RuleTutor provides a 
significant degree of generalized instructional intelligence, it does not 
eliminate the need for programming. In particular, what is needed is the 
equivalent of a ccnqputerized technology (method) for structural (cognitive 
tasks) analysis. And, as noted above, while recent progress has been made 

in this direction, the level of research effort required to bring such 

/ 

technology to^f ruition at present largely/precludes such development in a 
ccumercial context. 

More generally, in spite of these positive uses of instructional 

m \ ■ " 

systems design, both real apa potential, considerably more attention in 
future ; basic research must be given to dynamic, and highly interactive 
nature of CBI systems. The fundamental nature of such interaction, and , 
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its relationships to cognitive learning, need to be better understood if 
we are to realize the full potential of instructional systems design in 
_= |.<BI development . ^ 
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V. THE USE OF TECHNOLOGY IN INSTRUCTION ^ 
, . The technologies used to promote learning in schools range from the 
printed page, blackboards, overhead projectors, etc. , on the one. hand, 

i 

and f on the other, to television and other electronic forms of 
conrounications and computer^. Hie nain thing all of these' technologies 
have in conroon is that they can be used either well or badly. Their v 
effectiveness in promoting learning depends far more on the viability of 
the content and on the way the technologies are used, in most cases, than 
on the technologies themselves. This fact has been demonstated numerous 
times in educational research by the lack of reliable effects attributable 
to particular technologies (or to inst actional methods per se, e.g., 
Scandura, 1964) . • 



The present analysis is concerned exclusively with the advantages and, 
limitations of interactive ttchnologie%in education, most especially with 
those involving the use of computer^. .Interactive technologies by 
definition involve £wo-way communication as is the case with "live" 
instruction (and instruction by -means of tele-conmuni cat ions) . Until 'the 
advent of computers, with the exception of outmoded mechanical teaching 
machines," essentially all nonhuman uses of technology for instructional 
purposes involved one^y"cc«immicttion. Indeed, this limitation is 
p?haps the primary reason that television has never achieved the , ^ 
'educational impact that was once forecast. 

At the present time, the computer has three major but quite . ^ 
distinctive roles to play in instruction: (a) as an object to be 
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understood both in relationship to the circumstances and society in which 

* 

we live and as useful means (when combined with appropriate software) for 
getting things done more efficiently, >£b) as an object of study in its owq 
right, as knowledge and skills to be mastered a^d (c) as a means o£ 
assisting the learning process. 



Regarding the first role, caifputers are certain to have progressive 
ana far reaching effects on future society. Developments have reached the 

point where every child must achieve some degree of computer literacy, if 

j * . 

nothing else but to understand what is happen ing^tn the world around him 

or her. Since most educators feel this need personally, considerable 

attention is being devoted to this 'problem and little pore will be said 

here, " 

The second major role for computers in education is sometimes equated 

with the first but, is sufficiently different to warrant separate 

consideration. The emphasis in this case is on the computer itselt. This 

includes learning how computers operate' and developing the knowledge and 

skills necessary for getting computers to do what one wants (e.g., 

■ learning to program) . Just as students should become as verbally and 

' mathematically literate as possible, few educators would deny the need for 

today's youth to get as much training in these areas as they can 

reasonably absorb. 

Some proponents of computer training, however, go considerably beyond 

1 r «* 

these admirable goals, This view seems to be especially widespread among 
proponents of theLOGO progfanming language (e.g., Papert, 1980), In 
general, these individuals view learning in a manner analogous to the long 



discredited "mental discipline 11 view that dominated educational thinking 
around the turn of the century. - To wit: By learning to program, A person 
develops such skills as learning how to learn and how to create. As it 
has been put, they "learn how to control the computer instead of being 

controlled bit, it," It is undoubtedly true that students who learn how to 

4.. 

program nay 1^ higher level skills in the 

process. But,^learning tb prograft is hajrdly unique in this respect. 
Higher level skills are a potentially natural "outgrowth of any 
well-Utesigned learning experience (e.g., see Scandura, 197i, Chapter 1). 

Learning to program is a valuable skill and should be taught in 
schools. It would be d mistake, however, to think that learning IOG0, for 
example, is a viabl^ substitute for. learning nathenatics or any other 
subject matter as has sometimes been claimed (e.g., Paper t, 1980). To be 
sure, schools need to put as much emphasis as possible on acquiring 
learning skills, but this should be done in a variety of content areas, 

not just in learning to program. As stated by Professor Robert Tennyson 

* 

of the University of Minnesota (personal communication) "LOGO at best 
deals with processes — but without a knowledge base, processes are 
limited in utility." ' m 

Just as with the new math of the 1960's, perhaps the greatest 
limitation of the LOGO movement is that its effects ren^in undocumented 
despite millions of dollars of federal money used to support its 
development. To use the new mathematics as an analogy, it is not unlikely 
that over enipjhasis on LOGO as a means of < achieving more generalized 
educational objectives could result in the equivalent of learning the 
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language of mathematics (e.g.. "sets", "relations". "Ructions" and even 

• / 

theorem proving) with correspondingly lesser abilities in using 

/ 

M ath e ma tics to solve problems. The moral of the story, as always, is all' 
things in proper proportion. 

The third major role computers can play in promoting school learning 

is in CBI. As mentioned above, previous attenpts to introduce CBI on a ' 

'*.**- *<■■ / 
large scale were largely unsuccessful. The use of time sharing systems in 

■.■'/■. 

which one central oonpater was connected to a number of terminals 
typically offered variable response times and. for the meet part, limited 
graphic capabilities. 

In part because of these hardware limitations , the most successful 

early applications of CBI tended toward drill and practice — ' althou£i 

•* *. ** 

son* of the larger , better ^financed (but ccraaeriially unprofitable) 

-. Y 

applications, such as Control Data's FLKDD {which includes sophisticated 
^Tphics) featured tutorial CQI systems as well. , 

The variety of 'computerized educational systems which exist today 
largely defy neat categorization. Nonetheless, ccntenporary CBI software 
systems bend 1 to fall into one (or more) of tiyree nonexclusive categories: 
* drill and practice, tutorial systems, and simulations and educational 
Modelling. Drill and practice refers to those CBI systems which are 

talcped primarily to exercise previously learned skills. In arithmetic , 

/ . ■ * * 

' for aranple, good drill and practice CBI systems attenpt to build on 
" student familiarity with computational algorithms, providing practice 
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• J 
which leads to higher levels of skill (i.e.* to faster more accurate 

performance) . Drill juid practice systems have, been developed for a wide 

variety o£ topics, ranging from enhancing typing skills to expanding 

foreign language vocabulary. Generally speaking, today's low cost 

microcomputers provide a highly cost-effective means for developing and 

delivering drill and practice CBI, a fact wiijlch has not gone unnoticed by 

^educational publishers* > f 

As the label implies, tutorial CBI systems are designed to teach new 
information as well as to excercise previously available knowledge. 
Building on the previous illustration, for example, a tutorial CBI system 
in arithmetic might explicitly introduce a student to the ccnputational 
algorithms, rather than just exercise previously acquired algorithms. 

Tutorial systems can be envisaged in almost every conceivable area, 

«. * r 

ranging from teaching basic concepts and principles (e.g. , rules) to 
teaching complex, highly interrelated bodies of content; Generally 
speaking, to be classified as; a tutorial system, the information taught 

i 

must involve more than simply learning new facts (e.g., 'as in learning new 
vocabulary). H&e latter generally can be learned by simple drill and i 
practice. * 

The simulation and educational modelling category is less well 
defined bec^ise the available CBI systems, which might be so. classified, 
range from serious education , to pure amusement. One could argue that 
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every well designed CBI system has some educational value — even PAGMAN 
probably has some redeendng features. The relevant educational question, 
as always, is the value of what is learned when judged in terms of^he 
vtixoe speat, and particularly whether all or some of that time might be 

V 

,better spent on other activities, , . 

Unlike tutorials, which tend (but need not) emptosize instruction\by 
verbal mdans,- siinulations enphasize/instruction by illustration. In the 
simplest cases, for example, a simulation might consist of litt^more 
/ than an animated visual illustration showing, say, how an^ internal - 
combustion engine operates.' . , H 

This type of simulation, of course; might just as well be 
accomplished by film or/a mechanical modelling devise. As with all CBI 
applications, simulations must be interactive if they are to fully utilize 
the capabilities of the computer • ^ 

- In this same vein, educational modelling may range from the trivial 
to highly interactive models / ^lth / a serious educational message. In the 
latter category, for example, Howe (1982) and his associates at Edinburg 
and Bork and/his associates at Irvine (1992) have developed a number of 
ingenious Cbl systems which model significant segments of science (e.g., 
mechanics) , Th^se systems are highly interactive and are designed so that 
- the student learns (or discovers) scientific laws governing the domains, in 
, question as he or she interacts with the systems < 

To sunmarize, all three kinds of application have a valuable role to 
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play in instruction. Drill and practice is best where students need a . 

high level of skill in a «well defined area, ^utorial systems are best 

',...:"/■. 
where wtet must be learned is clearly defined and where learning should be 

as efficient as possible, Siitulations and educational modeling are best 

where the desired learning is more diffuse and/or less clearly defined. 

In this type of situation, one wants to introduce students to as wide a 

variety of related situation? as is feasible in the hope that .they will 

acquire a significant portion of what might be known. 
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VI. CONCLUSIONS AM) REO0WffiNDfl£TIONS 
Unlike nany other countries where the federal uoverrnq^nt determines 
educational policy, state and local governments in the United fetatea 
traditionally have been responsibly for the implementation of school 
curricula. Indeed, the rate at which educational technology, particularly 
in the form of ndcrocoiTput*rs f is being introduced into schools across the 
country attests to local wisdom in this respect,. 

As regards the federal role in instructional technology, the above 

v * ■ * 

analysis clearly deroonstates the following: (a), Technology and _ 

•particularly low cost microcomputers have a very definite role to play in 

education during the lSM's and beyond. These roles range from 

incorporating the study of technology into school curricula to the use of 

technology to improve instruction in other areas, (b) Although CBI 

systems have been of variable* quality , * the la^ft^otple of .yeats has 

witnessed rapid growth in the quality of educational software, (c) While 

much remains to be done, we have learned a good deal about cognitive 

learning and instructional processed during the past 20 years, (d) Very 

little^of the software which presently is available commercially, jnakes 

significant use of this knowledge base. 

The foregoing analysis also shows that past patterns of federal 

involvement in educational research generally, and .educational technology 
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in particular, have been less than optimal in their effectiveness. 
Specifically, the concentration of resources at a snail number of R & D 

/ . •* 

• '.* 

centers and laboratories has greatly diminish^ research conpetition and 
*. • 
effectively robbed the nation of badly, needed intellectual resources. * 

Moreover, r§3eht planning documents relWsed by the N.I.E. suggest that, 

while serious questions. are being raiped about the lack** of research 

competition, the concept of R & D centers per se could still be 

sacrosanct. If so, this could be a serious mistake, Given rapidly 

i V ' . . 

increasing international competition from Japan and elsewherev as well as 

- . ' 1 « J 

very real constraints on the federal bucket, it seems imperative that the 

r role of the federal government in educational technology be reevaluated • 
witnout preconditions. v V%> , k 

.These observations lead to the following recommendations: 
(1) Experience shows that commercially viable, large scale 
development efforts in educational* techrology riay f ar more efficiently be 

landed by the private* sector • In the present view, government at all 
level?, specifically incl£iding the N. I . fc. labs and centers, should • 
gradually withdraw from such efforts almost completely. Whatever savings 
accrue at the federal level from such changes in enptapis should be 
reallocated to.bfrsic research in instructional technology and to the 
(fcvelopnj^nt of advanced prototypes, ^he, results of such efforts should 
provide the "seed corn" 1 from Which the private sector in the U.S.A* might 



(2) Although the long ten* payoff of - basic research has been proven 
time and time again (as described herein in the case of educational 
technology), the results typically obtained sure sufficiently general and- 

innjediate payoff k ^ so unpredictable in any sjaecific case, that it 
would be' infeasibie, and rarely cost effective, to expect significant * 
direct support 'for this type of effort from the private sector or from 
states <ahd local governments, Os * 

ttt>e federal government, therefore, should I cxncmtJiW^its efforts in 
educational technology on those things that- can only or roost efficiently 
be done at a national 'level. In general, this means an emphasis on basic 
research ,\ including relevant ijhsjtr uctional theory, instructional systems 
design, and ,the development of ajivahced technological prototypes and 
general informational services not otherwise attainable 1 
:y (3) Since the Value of basic research is primarily contingent on the 

rather than sim$l£ magnitude of effort, federal support 
should; be directed toward those individuals who propose the nost promising 

pjrogran|i©tiq efforts and who have denkustrated the ability to, carry such 

■ ' ' • ■ * ■ v 

efforts to fruition. -* J ■ % V 

■■■' v ^Specif icallj^whenever feasible^ Cvariety. of approaches should be 
funded. As this analysis clearly showfe, putting* ail pf one's eggs in one 

■ • * ■ ' " ' ' .: V ' * 

basket is a serious mistake when it comes to research and advanced .< 

.*■'"• . . 

developient. A variety of smaller programmatic efforts over a period of 
time has time and time again proven its worth over the cyclic fadisnf which 



- too frequently has characterised behavioral research, 

J (4) In this regard, because of the time and often -inprodu#ive < ef fort 

% involved in preparing proposals, federal officials should give more 

attention both to .mp4x4 z ^9 ^^'!^^ rts (and correspondingly to placing 
more enphasis on "end products") and to c*^-benef it analysis of the 
likely benefits of holding "open* competitions when less than, for. 
^ , example, 25% o^^ --.V / \ 

V Experience at other (non educational) research agencies suggest that 
it £s far more efficient, both for agencies and proposers, for the 
agencies to make preliminary judgements based on brief letter proposals — 
if necessary with expert opinion front outside the agency; More complete 
f proposals in such cases are only requested where there is a reasonably 
high possibility of funding..^ To insure that competitive ideas are fairly 
evaluated, reviewers at alJL: levels should both be compensated for, their 
time ariti held accountable for inaccuracies or bias in their reviews, > 



hi. 



(Minimizing bias; for example, might be acconpUshed making reviewers ; 
known to proposers; this pr^ctfi^e also might provide A useful mechanism 
for clarifying misconceptions^ [) 1 Societal needs in instructional technology 
are too important to ^llow form to stahd in the way of substance, r 
'(5) Rearnnendatldfts (3) and (4) inplicitly assume that the Congress 
will recognize both the very real needs in irietruqJ:ional technology and 
the problems which have, arisen as a result of noncompetitive funding * of * 
the N.I.E. colters and laboratories. It also, assumes that the Congress 
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_ %^JJl reassign ^moneys qurrently nandated^to centers and laboratories, 

^ mkin^i them available £or free and open; qorpetition, (In this regard, it 
= £. must be enphasized that the total amount of federal money allocated for v: 
research in educational technology is di'stressingly small when donpated - 

/ with their provided by the Japanese and many European governments. It- is 

■■.»■' ■ . . . * - - 

c ' - . 

apparent both to this reviewer and to everyone who has reviewed or 

> > . i ' ' 

otherwise reacted to th^ report that research funds should be* increased • 

to the extent that b^e^ary condition? will allow, : ;^r|5^ie : 'few areas " 

that, could have iipf e JSearing oil the future of American 

society in a technological 'world.) , . '!-«? 

■«>• . ■ * ... / .. . T 

In the absence of - Congressional reallocation (of the, mandated center' 

. • . ■ • ' ■ • 

>na laboratory funds), the definition of vi^t co^ cfenter or o 

.. . . laboratory should be modified so as to place the enphasis on snail, ( 

competitive progrannatic efforts by independent researchers and tt)eir 

associates. In this context, for example, it/copld. be a serious mistake 

to start gnfe hey qfenter or laboratory in educat^c^l^technology, not * 

because more ^rogramnatic efforts in this area! 'are n6t (badly) needed. It 

would be a Mistake because such a center w6uld inevitably end up, dominated 

by one or at roost two of three themes to the exclusion of otherwise 

equally carpet it ive ideas. ' ° 

A better way would be to fund a variety o£ -aiall^r, carpeting 

prbgrannrftic efforts by leading investigators under center or laboratory ; y 

auspices. These leading investigators woul& normally be scattered at ' 



various locations throughout the couitry. Rarely are the best people at 




*:|tritef naft c^ter /laboratory conrounication would not be a 
probliSrt' in this case because of the scientifically competitive 
nature of the respective efforts. Periodic scientific meetings 
and modern teleoonrounicaticns would tend to minimize * 
unproductive political activity and be ioqre than adequate for 
scientific exchange. Evaluation of the various progranroatic 
efforts within such a center might best be acconplistyed by e 
independent and 'philosophically balanced teams of experts from 
"outside the system.-" 



y y\ references k •. • • 

Bork, A. ^uhlic understanding of science via carputers. Paper given 
at AEKA, 1982. ^ ' 

Self descriptive. • ■ • t . , 

Brown,. J. S. A process model for a generative theory of bugs. Xerox Palp 
Alto Research Center f 1980. 

Describes eonputer models for identifying sdurces of dfiildr ens 
errors. 4 

Chancj, C>< and Lee r R. Symbolic logic and mechanical theorem proving. 
New York: Academic Press, 1973, 21Q-231. 

An advanced text dealing with mathematical foundations upon 

whidh instructional theory has drawn. ( 

s. 

Cordes, C. Search goes on fpr 'best 1 ways to learn science. APA Monitor; 
April, 1983. „ : " * 

Refers to purportedly new problems and scientific advances. 

Crowder, N.A. Automatic tutoring by means of intrinsic programing. 

In B.H. Galanter (ed # ), Automatic Teaching: The state of the art. 
New York: Wiley, 1959, 109,116. 

An fairly discussion of teaching machines. 

purnin, J.H. and Scandura, J.M. An algorithmic approach to assessing 
behavior potential: Comparison with item forms and hierarchical 
analysis. Journal of Educational Psychology, 1973, 65, 262-272. 

Describes a theory of diagnostic (criterion referenced) testing 
together with supporting empirical data. 

Parley, F. 1980 Editorial on NIE priorities. Educational Researcher, 
1981. 

A criticism of NIE priorities. 

Gage, N.L. Theories of teaching. In E.R. Hilgard (ed.), Oheoties of 

learning and education: Yearbook of National Social Studies Education 
1964. „ 

Provides a general overview of teaching theories and their properties. 

Gagne, R.M. The acquisition of knowledge. Psychological Review, 
1962, 59, 355-365. 

An early intrpducticn to task analysis. 

42 



Gagne, R.M., and Briggs, L.J. Principles of instructional design. 
New York: Holt, Rinehart and Winston , 1974. 

A widely used text in instructional design. 

Gagne, R.tt., Instructional psycihology. Annual review of , psychology. 1983 # 
34, 261-295. , 

A recent review of theory, research and development in 
instructional psychology. 

Glaaer, R._ Instructional psychology; Fast, present, and. future. 
American Psycologist, March, 1982, 292-305. .; , / 

A recent sunroary of one perspective on instructional 
psychology. 

Hively, W., Patterson, H.L. t and Page, S. A "universe defined" system of 
arithmetic achievement tests. Journal of Educational Measurement, 
1968, 5, 275t290. * 

Describes and evaluates empirically the use of item forms 
in criterion referenced testing. 

» i ■. 

Hcw§, J.A. Learning sedfandary school mathematics through programming: An 
exoercise in cognitive engineering. Paper' given at IAAP 
congress. Edinburgh, 1982. 

Describes several experimental CBI systems. v 

Ianda, L.N. Algor itemization of learning and instruction. Biglewood 
Cliffs, N.J.: Educational Technology Publications, 1974. ... 

Describes a cognitive approach toHLnstructional design. 

# 

Mager, R.P. Developing attitude toward learning. Belmont, Ca.: Etearon, 
1968. y> 

Deals with behavioral objectives. 

Melton, A. W. The science of learning and the technology of educational 
methods. Harvard Educational Review, 1959, 29, 96-106. 

An early discussion of the relationship between the psychology of 

t learning and instruction. . 
rrill, M.D. Synopsis of an analytic approach to instructional design. 
Journal of Structural Learning, 1979, 167-lfa. " "T 8, 

Self descriptive. 

43 



43 

Merrill, P.P. Top-down analysis and structured programing in rule * 
diagnosis. Paper given at AERA, 1982. 

•> 

Discusses, relationships between programning concepts and the 
^ ' structural learning approach to diagnostic testing. 

IJtewell, A. and Simon, H. A. Human problem solving. Biglewood Cliffs, 
N.J.: Prentice-Hall, 1972. 

Describes a long-term effort in the corputer simulation of human 
thoucfit processes. r 

Novak, J^D. Analysis of Concept Learning. New York: Academic Press, 1966. 

Describes a conceptual approach to instruction. 
Page, E. 1980 Editorial cn,NIE priorities. Educational Researcher, 1981. 

A criticism of NIE priorities. y \ 

Paper t, S. Mindstorms: Children, conputers and powerful ideas. N.Y. : 
Basic Books, 1980. < 

r 

Describes the LOGO programming language and hypothesized relation- 
ships to children's learning. 

Bask, G. Conversation, cognition, and learning. Amsterdam: Elsevier, 
1975. % 

Describes "conversation theory," a systems perfective on human 
interaction. .J 

Popham, W.J. and Baker, E.I. Planning an instructional sequence. Englewood 
Qiffs, N.J.: Prentice-Hall, 1970 

Based on behavioral objectives. i 

Reenick, L.B. Instructional psychology. Annual review of psychology, 1981, 
32, 659-704. 

Reviews, research in instructional psychology, much of it conducted at or 
in conjunction with the JKDC in Pittsburg. Also proposes that 
developing instructional implications of cognitive psychology is 
a major "new" problem for the 1980's. 

T " 

Scandura, J.M. An analysis of expository and discovery^mbdes of 

problem solving instruction. Journal of Experimental Education, 
1964, 33, 149-159. 

A series of studies demonstrating that minor within netfiod differences 
may have a greater effect on learning than. differences between 
methods themselves. 

Scandurfc, J.M. Mathematics: Concrete behavioral Foundations', New Yak: 



44 



Harper & Row, 1971, 3-61. 

Text on mathematics and methods for teachers. 

Scandura, J.M. Deterministic theorizing* in structural learning: Tftree leveli 
of enpirician. Journal of Structured Learning, 1971, 3 f v 21-53. 

Basic introduction to the structural learning theory and 
research roethodolgy. „ y 

Scandura, J.M. Structural learning I: Theory and research. London/New 
York: Gordon & Breach Science Publishers, 1973* 

Technical and* more, complete source on structural leeurning. 

Scandura, J.M. Ufejrole of higher-order rules in problem solving. Joutnal 
of Experimental Psychology, 1974 r 120, 984-991. / 

Experimental demonstrations of the role of higher-order > rules. • 

Scandura, J.M. (ed.). with contributions by Arbib,M., Corcoran, J., Domotor, 
Z., Greeno, J., Lovell, K. , Newell, A. , Ros^ibloom f P. , Scandura, 
j; r Shaw, R., Simon, H. , Suppes, P. , . Wittrock^ M. , and Witz , K. 
.v Struct ual learnincLII: Issqes ai>d approaches, I/jh^/New York: 

J Gordon jk Breach sJfence Publifeherfe. ?1976-.»' 



A wide variety of contributions, ^hasizing struct^^ 
theories of \jearning and instruction^. v ■ / 

Scandura^ J.M., Structural approach to instructional problems. American 
Psychologist, 1977, 32, 33-53. (a) 

Lists and shows how a number of purportedly "new* problems had 

already been solved. 

* i. - . 

Scandura, J.M. Problem solving: A structural/process approach with 
instrilcticnal implications. New York: Academic Press, 1977. (b) 

Theory, research and methodology in problem solving, with direct 
reference to individualized instruction. Also compares and 
contrasts various lines of cognitive instructional research, 
~ especially in Chapter 15. 

Scandura, JvM. Theoretical foundations of instruction: a systems alternative 

. to cognitive psychology. Journal of structural learning, 1980, 6, 
347-393. 1 ; 

Self descriptive. 

Scandura, J.M. Microconpiter-based system for authoring, diagnosis 
and instruction in algorithmic content. Educational Technology, 
1981, 13-19. 

' 0 4 

Self descriptive. ■ 

45 



45 



Scandura, J.M. Problem solving in schools and beyond: Transitions 

from the naive to the neophyte to the master; Educational Psychologist, 
1981, 16, 139-150. 

Describes a theory explaining the progression froin naive to expert 
learning. J 

Spandura, J.M. The general purpose RuleTutor: An intelligent CBI 
system. Paper given at the American Educational Research 
Association. New York, 1982 and other meetings. 

One of a series of talks given at national and international meetings 
describing a cognitive-based CBI development system. . 

gcandura, J.M., TWUlfeck, W.H.,II, Durnin, J.H. and Ehrenpreis, W. *~ 
Diagnosis and instuction of higher-order rules for solving 
geometry construction problems. In J.M. Scandura, Problem Solving, New 
York: Academic Press, 1977, 437-458. 

A structural analysis of a ccnplex domain of mathematics. 

Seigler, R.S. Issues in studying developmental change: -An editorial 
suragary of a contribution by R.S. Seigler with conments by 
W. WUlfeck. Journal of Structural Learning, 1979, 177-179. 

Self descriptive. 

Tennyson, R. The Minnesota authoring system, AERA, 1980. 

Self descriptive. i * ■ .J ■ 

WUlfeck, W.H., and Scandura, 3.M. Theory of adaptive instruction with 
application to sequencing in teaching problem solving.* In J.M. 
Scandura, Problem Solving. New York: Academic Press, 1977 , 459-478. 

Describes and evaluates empirically an advanced ccnputer-based 
learning environment. 

4 



4 



46 



